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Abstract 

In this paper we consider a version of the functional Hodrick- 
Prescott filter for functional time series. We show that the associated 
optimal smoothing operator preserves the ’noise-to-signal’ structure. 
Moreover, we propose a consistent estimator of this optimal smooth¬ 
ing operator. 
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1 Introduction 

The study of functional time series has attracted a large amount of research in the 
functional data analysis literature (see for example, Hermann and Kokoszka (2010), 
Horvath et al. (2010), Horvath and Kokoszka (2012)). Functional time series can be 
obtained by splitting an almost continuous time record of measurements (functional 
data) into natural consecutive intervals, and the measurements in each interval are 
treated as a whole observational unit. 

For simplicity, a functional time series can be seen as a sample consists of n curves 
Xi,X 2 , ■■■,Xn belonging to the space L^([0,1]) of square integrable functions on 
[0,1], where Xi = {Ai(t);0 < t < 1}, i = l,2,..,n; i refers to a day, a month or 
a year, and t is the time within that unit interval representing a sufficiently dense 
grid of times (tics, seconds, etc.) at which an observation A„(t) is made. 

The classical Hodrick-Prescott filter (called henceforth the HP filter) was intro¬ 
duced by Hodrick and Prescott (1997) and since then it has been used widely in 
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economics and actuarial science. The classical Hodrick-Prescott filter was pro¬ 
posed as a procedure of extracting a ’signal’ (also called trend in the economic 
literature) y{a,x) = {yi{a,x),... ,yT{a,x)) from a real-valued, noisy time series 
X = {xi,... ,xt) and an appropriately chosen positive parameter a, called the 
smoothing parameter. They suggested that the real-valued time series (x, y) satis¬ 
fies the following linear mixed model: 


f x = y + u, 
\ Py = v, 


( 1 ) 


where u ^ and v ^ (It and It -2 denote the T xT and 

(T — 2) X (T — 2) identity matrices, respectively) and P is the discrete second 
order differencing operator {Py){t) := yt +2 — ‘^Vt+i + 2 /t, t = 1, ■ • ■, T — 2. For an 
appropriate smoothing parameter, the ’optimal smooth’ signal associated with x is 
the minimizer of the following functional 


T T-2 

XI “ yt)^ + o^^iyt+2 - ^yt+i + yt)^, 


( 2 ) 


with respect to y = {yi,..., yr)- Using the model ([T]) above, the optimal smoothing 
parameter turns out to be the so-called ’noise-to-signal ratio’, i.e. a* = 

Schlicht (2005) proved that the noise-to-signal ratio satisfies 

E[y\x] = y{^,x) (3) 

and is optimal in the sense that (see Dermoune et al. (2009)) the optimal smoothing 
parameter minimizes the mean square difference between the ’optimal signal’ y{a, x) 
and the conditional expectation E[y \ x] which is the best predictor of any signal y 
given the time series x, namely 

=argmm{||F;[y|x]- 2 /(a,x)f}. (4) 


Moreover, Dermoune et al. (2009) derived an explicit unbiased consistent estimator 
of the smoothing parameter. They dealt with the observations from the Gaussian 
time series Px: 

Px = V + Pu ^ N{0,allT-2 + cr^PP ), 
to suggest the following consistent estimators of the variances cr^ and 


and 


= 4(r - 3) ^ P<3)Px{j + 1), 

^ ' j=i 

" ^ (r-2) ^ ^ 2(r - 3) ^ + !)• 


(5) 

( 6 ) 


Due to the noise-to-signal ratio, the optimal smoothing parameter a* admits the 
following consistent estimator 


^ 1 / 3 ^ \ 

4 2 (T - 2)Ej=t P<J)P<3 + 1)7 
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Djehiche and Nassar (2013) suggested a functional version of the Hodrick-Prescott 
filter for which the data x take values in a possibly infinite dimensional Hilbert 
space. The functional HP filter is described as a mixed model of the same form 
as o, where the second backward difference operator P is replaced by a compact 
operator A. They characterized the optimal smoothing parameter determined by a 
criterion similar to (jT]) where the noise u and the signal v are independent Hilbert 
space-valued Gaussian random variables with zero means and covariance operators 
Su and 

Furthermore, Djehiche et al. (2013) extended the functional Hodrick-Prescott filter 
to the case where the operator A is closed and densely defined with closed range. 

In this paper, we extend the functional Hodrick-Prescott filter to the case of func¬ 
tional time series, using the second order differencing operator. We also characterize 
the optimal smoothing operator, based on the optimality criterion suggested in Dje¬ 
hiche and Nassar (2013). Moreover, we suggest an explicit and consistent estimator 
of the optimal smoothing operator. 

The paper is organized as follows. In Section 2, we introduce the Hodrick-Prescott 
filter for functional time series. In Section 3, we prove that the optimal smoothing 
operator preserves the noise-to-signal ratio structure. In Section 4, we propose a 
consistent estimator of the optimal smoothing operator. 

Functional time series such as: intradaily financial transactions. Geophysical data, 
magnetometer data (for further details, see [13]) are good examples to apply this 
study. 

2 The functional Hodrick-Prescott filter for func¬ 
tional time series 

In this section, we propose the functional Hodrick-Prescott filter for functional time 
series, where the observations X can be seen as a vector of n entries of functional 
data. 

Let X = (Xi, X 2 ,..., X„) be a functional time series, where X^ S L^([0,1]) for 
i = l,2,...,n. The functional Hodrick-Prescott filter for functional time series is 
a procedure to reconstruct an ’optimal smooth signal’ Y = (Yi, Y 2 ,..., Y„) that 
solves an equation 


PYm = Ym +2 - 2Ym+i+Ym = ^771, TO = 1,2,..., n - 2, (8) 


corrupted by a noise V = (Vi, V 2 ,..., V„_ 2 ) which is apriori unobservable, from 
observations X corrupted by a noise U = (Ui, U 2 ,..., U„) which is also apriori 
unobservable: 



(9) 


The second order backward shift operator P can be written in vector form as the 
following (n — 2) X n-matrix 
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/l -2 1 0 . 0\ 

0 1-21 . 0 

0 0 1-2 1 ... 0 . 

\0 0 0 0 1 -2 ly 

Following [3], let B : L^([0,1]) —^ L^([0,1]) be a smoothing operator, which is 
linear, bounded and positive. The optimal smooth signal, associated with X, is 
obtained by regularizing the system 


Y(B,X) :=argnhn^^||X, 
^ I i=i 


Y, 


2 

L 2 ([o,l]) 


provided that 


(/l,5/i)L2([0,l]) > 0 , 


n-2 

+ ^((PY)„il(PY),)i.([o.i]) , 

i=i ) 

( 10 ) 


heL\[o,i]). 


To find the optimal smoothing operator, we will use the selection criterion in [4], 
namely: 

.B = argmin||F;[Y|X] - Y(B,X)f . (11) 

B 


This selection criterion minimizes the difference between the optimal solution Y(B, X), 
and the conditional expectation ^[YIX]. 

The main aim of this work is to derive a consistent estimator of the optimal smooth¬ 
ing operator B, extending the results of [3] to infinite dimensional case. 

Let {ei, 62 ,..., Bj,...} be an orthogonal basis in B^([0,1]) (a well known example 
of a basis in B^([0,1]) is {ei{t) = •\/ 2 sin(i 7 rt)}, i = 1,2,...). Xi,Yi,Ui admit the 
following representation for i = 1 , 2 ,..., n, respectively: 

OO CX3 OO 

= Y,=Y,yiej, U, = 

1=1 1=1 1=1 

and Vi admits similar representation for l = l, 2 ,...,n — 2 : 

OO 

Vi = 

1=1 

For arbitrary j the projectors of X, Y, U and V onto the eigenspace Spanjej}, can 
be seen as the following vectors in K" and respectively: 



_ ^3 \ 

v*^ 1 ? 5 * ■ * ’ ^nJ ^ 


C/l = (Mj,u^,...,0 

and 




Hence 

OO 

OO 

OO 


II 

M 

II 

M 

II 

M 


1=1 

1=1 

1=1 
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and 


V = ^ 


2) 


i=i 


where, 


\ / Ixn 


and 


-(n-2) 

= 


^(cj, 0, ..., 0 )]^J^„_ 2 , (0, ej, ..., 0)ixn—2 j •■•! (®I •■•! ®i)lxri—2^ ^ 

Moreover, the system ([51) yields that for every j 


Xn—2 


r x3_ = Y3_+w, 

\ PYI = V^, 


where P is the real second order differencing operator 

■= yln+2 - ‘^vln+i + yi; m = i,..., n - 2. 


( 12 ) 


(13) 


Since the smoothing operators B is linear and bounded, by Riesz’ Representation 
Theorem, there exist uniquely determined > 0, j = 1,2,..., such that 

OO 

Bh = '^aj{h,ej)ej, heL^{[0,l]), (14) 

1=1 

where the sum converges in the operator norm. 

Following Dermoune et al. (2008), the optimal smoothing signal associated with 
can be found as in m i-e. 


Y^ (aj ,X-^) = arg min i ^ (x^ 
^ I i=l 


n—2 

ylf + 

2 = 1 



(15) 


The minimizer is given by the formula 

Y^{a,,X^) = {y{{a,,X^),yi,{a,,X%...,yi{a,,X^)) = {Ir, + a,P'P)-^XY (16) 


We have 


Set 


^Y^a„X^)^^^ = (/^«n +RP'P)-1X. 
1=1 


Y(R,X) = (/ff®n +RP'p)-iX. 

Proposition 1. Assume B : T^([0,1]) —1 .^^([0,1]) satisfies 
(/i,i?/i)i2([oq]) > 0, h e L^([0,1]). 
then CHP is the optimal smoothing signal which minimizes the functional 

n n—2 

Jb{Y) = l|X, - ^ ((PY)„ B(PY),)i2([0,q). 


2=1 


2=1 


(17) 

(18) 


(19) 
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Proof. To prove is the minimizer of the functional Jb(Y) we will use the 

fact that {aj, X^) is the minimizer of the functional 

n n—2 

XI“ ‘^yUi + yif^ 

2=1 


for each j. By a simple computation we have 


Jb{Y) = X l|X. - + X {{PY),,B{PY),)B.ao.i]) 

2=1 2=1 

n CO 2 n—2 oo oo 

= XX “ 2/f) + X ^X (^i +2 “ “^yi+i +yi) X“fe ( 2/^-2 “ + Vi) efc) 


i=i i=i 
n oo 


i=i i=i 
n—2 oo 


fc=l 


XX(2'*“22-) +XX“j(y*+2“2yf+i+220 


i=i i=i 

OO / n 


2=1 j = l 


n — 2 


> X X(^i “ + aj X(22i+2(«i:X^) - ‘^yi+i{aj,X^)+ yj(aj,X^)f 

j^l \i^l 2=1 

> Jb(Y(S,X)). 


□ 


3 Optimality of the noise-to-signal ratio 

We will now characterize the optimal smoothing operator, defined by m , associ¬ 
ated with the Hodrick-Prescott filter (nni). 

In ([HI), the equation PY = V has a solution of the form 

Y = Yo + P'iPP')-^V, (20) 

where lb = Zj such that the n x 2- matrix Z satisfies 

PZ = 0, z'z = l 2 

with 7 G L^([0,1]) X T^([0,1]) can be chosen arbitrarily, and 

X = lb + P'(PP')-W + U. (21) 

From dini) and cm, a stochastic model for (X, Y) is determined by models for Yq 
and (U, V). We assume under the following assumptions. 

Assumption (1) lb is deterministic. 

Assumption (2) Let Ui, U 2 ,..., Un be independent and identically distributed 
Hilbert space-valued Gaussian random variables with zero mean and covariance 
operator S„ : L^([0,1]) —>■ L^([0,1]), where the covariance operator S„ is a linear, 
self-adjoint, positive-definite and trace class operator on L^([0,1]). 

Assumption (3) Let Vi, V 2 ,..., Vji _2 be independent and identically dis¬ 
tributed Hilbert space-valued Gaussian random variables with zero mean and co- 
variance operator : L^([0,1]) —>■ L^([0,1]), where the covariance operator is 
a linear, self-adjoint, positive-definite and trace class operator on L^([0,1]). 


6 


Since the covariance operator I]„ is trace class and thus compact, by Riesz’ Rep¬ 
resentation Theorem, there exist uniquely determined fj-k > 0, fc = 1,2,..., such 
that 

OO 

= heL^{[0,l]): (22) 

i=i 

where, the sum converges in the operator norm. Similarly for E^,, there exists 
uniquely determined >0, k = 1,2,..., such that 

OO 

= heL\[0,l]), (23) 

1=1 

where, the sum converges in the operator norm. 

For each j, Uj is a real valued Gaussian random variable with zero mean and 
covariance operator : R" —>■ R", where the covariance operator E^^. = In 

terms of Ej;., we have 

OO 

5:o = Esc't’- 

J = 1 

Similarly, Vj is a real valued Gaussian random variable with zero mean and covari¬ 
ance operator Yiy. : R" —>■ R", where the covariance operator Y^y. = TjIn- 2 - 

Assumption (4) Let Ur- and Vs be pairwise independent for all r = 1, 2,..., n 
and s = l,2,...,n — 2. From this assumption, it follows that and are inde¬ 
pendent real random variables for every j. 

Given Assumptions (1), (2), (3) and (4), in view of (EH)) and (1^ . it holds that 
(X, Y) is Gaussian with mean {ECX.), E(Y)) = {Yq,Yq), and covariance operator 

where Ex, Exy and Ey are operators on iJ®", with Exy = Syx- 
Proposition 2. Under Assumptions (1), (2), (3) and (4), we have 


((Exef \ ei"^)) = Ex.-d.fe, = Yy,5,u 


and 

((ExYet\ei")))=Ex.-Y.-<5,fe. 


with 

Sx = Su -f YyP'{PP')-\PP')-^P 

(25) 


Ey = YyP'{PP')-\PP')-^P, 

(26) 

and 

SxY = YyP'{PP')-\PP')-^P. 

(27) 


are trace class operators. 
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Proof. For each j , equations (EOl) and (EU have the form 


and 

Xi = + P\PP')-^V^ + UP 

Due to the independency assumptions, we have for every j p k: 


(28) 

(29) 


cov [XPX'^) = cov {Y^ + P'{PP )-^V^ + UPY^ + p\pp')-^V'^ + U’^) = 0, 

cov {YPY’^) = cov {Yi + P'{PP')-^V\Y^ + P'iPP'y^V’^) = 0, 

cov {XPY’^) = cov iXi + P'{PP')-^V^ + tjpY^ + P'{PP')-^V’^) = 0. 


and 


= cov {Y^ + P\PP')-^V^ + UPY^ + P'{PP')-^V^ + W) 
= E^,p'(PP')-i(PP')-ip'+Ep,, 


(30) 


Then 


Ey, = cov {Y^ + P {PP')-^VPY^ + p'(PP')-iy'=) 

= Ep,p'(PP')-i(PP')-ip', 

YxoY = cov {Y^ + P'(PP')-ifo^ + C/^Eo'^ + P'(PP')-it/'=) 
= E^,P'(PP')-1(PP')-1P'. 


T") 


((5^X6^ 


T") 

4 


)) 


= p 

\x-Yo,^'^^){X-Yo,i^'>) 

= E 

\X^ - Yi){X>^ - Y^) 


_/ 

COY {X^ ,X^) =Q, jpk, 

"I 

) j — k. 



i.e. ((Exf^"\ ^"^)) = TfXjSjk- For Ey and Exy similar proofs are hold. 
Now we will prove equation (113. To this purpose, we will prove first that 


(31) 

(32) 


(33) 


OO 

Sx = ^ ^Xi fo ■ 
i=i 

Since Ex : —?> P^", it has the following n x n-matrix 


^SxiXi 

SxiXa ■ 

■ ^XiX„ 

\ 


SX2X2 ■ 

■ ^X2X„ 


VSx„Xi 

^X„X2 ■ 

■ ^X„x, 

J 


where ExjX™ = ^x,nXi '■ H ^ H, for all l,m = 1, 2,..., n. Let the operator Ex,Xm 
admit the following representation 

OO 

^XiXrr, = ^XiX^^h^ fo)ej, (34) 

1=1 
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where (^^XiXm numbers. 

In view of (I51)) . we have 


(Sxix^ej,Cfc) = (cr^,x„ej: efc) = | ^ ^ ^ _ . (35) 

On the other hand, the operator Sjjfj : K" —>■ K" has the following n x n-matrix 

/coy{x\,x\) cov •■■ COY {x^i,xi^)\ 

_ _ cov(4,a;{) cov {xi,xl) ... cov (x^^xi) 

\cov (a;^,a;{) cov (a;^,x^) ... cov {xi,xi)/ 


where cov (xjjXj^) are real numbers, for all Z, to = 1, 2,..., n. 
Moreover, 

(Sx,x„ej,efc) = E{{Xi,ej){Xm,ek)) = E{x{x^) 

^ f 0, 3 ^ k, 

\ cov(xj,xi,), j = k, 


(36) 


where, for j ^ k,, E{x\x'^) = 0 follows directly from the fact that cov {X^, X^) = 0. 
Comparing (IMll with (IH^ gives that cr^iX^ — cov(xf,x^) for all l,m = l,2,...,n. 
Let h = {h, h ,..., h) S with = {{h, ej), {h, Cj ),..., {h, ej)) G K". Then 


Exjh^ — 


a^x^X2ik,ej) 
'x2Xiik,ej)) cr^x2X2(k,e.j) 




XnXi 


{h,ej) 


(7‘ 




{h, Cj) 


XiX, 

^X2X, 


XnX, 


{h,ej) 

.{h,ej)/ 


Multiplying with Cj and summing up over j, it gives 



(j2T=i^XX^{k,ej)ej 

'LT=i^XX2ik,e3)ej . 

■ 1^3 = 1 ^XiX^ 

{h,ej)ej 

OO 

Sj=i (k, Cj)ej 

Sj=i ^X2X2 ej)ej 

■ Z^j=i^x2X„ 

{h,ej)ej 

i=i 

vE“iO-Lxi(^.ei)ej 

Sj=l ^X„JV2 ■ 

\-^oo 7 

■ J2j=l ^x^x. 

{h,ej)ej 


^ExiXih ExiXa^ ■ 

■ ExiX„h'^ 




= 

Ex2Xih ■ 

■ Ex2Xnh 





\Ex„Xih Sx„j^2^ ■ 

■ Ex„x„hj 





= Exh. 


Now, using dsni), we get 

OO 

Exh = ^ Exjh^Cj 
j=i 

OO 

= Y,^viP'{PP')~\PP')~"P'h^ej + 

j=i 

= Euh + EvP'(PP')~^(PP')~^Ph. 
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i.e. equation (EH) is true. For (l26)) and (Ell), similar proofs are hold. Since the 
operators Eu and Ev are trace class, it follows that Ex,Ey and Exy are also 
trace class operators. This finishes the proof. □ 


We will next compute the conditional expectation for jointly Gaussian random 
variables X, Y. 

Proposition 3. The conditional expectation of Y given X is 


E [Y|X] = LX 

= £;[Y] + ExyEx' (X-£;[X]), 

provided that the opertor 

T = ExySx^ 

is Hilbert-Schmidt. 

Proof. Following Mandelbaum, we evaluate E Y|(X, ..., (X, 


(37) 


(38) 


. We have 


E 


Y|(X,ei")),...,(X,e1^))' 


= E [Y|X\...,X'"] 

oo 

= J2e[y^x\...,x^ 


-(n) 

S' 




= E[Y^ 


S' 






The last equality is due to the independency. But relaying on the explicit form of 
the conditional expectation for jointly real Gaussian random variables Y ^, X^, we 
have for every j 


E [Y^\Xq = E[Y^] + Ex.-y.'Sx- - E[X^]) . 


This yields 


L;[Y|(X,ei),...,(X,e^)] = L^X, 


where 


OO m 

i=i 


By taking the limit when m goes to inhnity, where by Proposition V-2-6 in |25] the 
convergence takes place in a.s., we obtain the formula (I571) of the conditional 
expectation. 


It remains to prove that L is a Hilbert-Schmidt operator. Since Ex is injective and 
trace class, the operator E^^ is Hilbert-Schmidt. Hence, T is a Hilbert-Schmidt 
operator, since it is a product of a trace class operator with a Hilbert-Schmidt 
operator. □ 


The following theorem characterizes the optimal smoothing operator as the 
noise-to-signal. 


10 






Theorem 4. Under Assumptions (1) to (4) hold, the smoothing operator 


OO 

Bh = J2—{h,ej)ej=^uK^h, h e L\[0,1]), (39) 

i=i 

is the minimizer of the functional 

IiB) = \\E[Y\X]-YiB,X)\\\ 


where the minimum is taken with respect to all linear, bounded operators which 
satisfy the positivity condition 

(/i, 1]) > 0, /i G L^([0,1]). 

Proof. To show that B minimizes the functional J, let B an arbitrary linear, 
bounded operators which satisfy the positivity condition and prove that I{B) > 
I{B). 

I{B) = \\E[Y\X]-Y{B,X)f 

2 

OO OO 

= E ^ [r^] ef) + {X^ - E[X^]) ef) - ^ ^ 

3=1 3=1 

OO 

= E 1^ [r^] + - Em) - 

3 = 1 


But, as a direct result of Dermoune et al. (2009), the functional 

\E [y^] + m - Em) - YHc^3,m\" 

has a unique minimizer aj = ^ (which is the optimal smoothing parameter asso¬ 
ciated with the system (TT^ l. 

Hence 

J(B) > Jl(B). 


it remains to show that B is linear and bounded. The covariance operator is 
linear and bounded, since it is trace class, with > 0. By the bounded inverse 
theorem HU, E.J, ^ exists and is bounded. Furthermore, 13 is bounded, since it is a 
product of a trace class operator with a bounded operator. □ 


Next we will present our main result is this paper. 


4 A consistent estimator of the noise-to-signal op¬ 
erator 

In this section, we propose a consistent estimator of the optimal smoothing operator 
B, i.e. an estimator, est-H, that converges in probability to B as the sample size 
tends to infinity. Due to the fact that B is the noise-to-signal ratio, it suffices to 
find consistent estimators of the covariance operators and E^,. 
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From Dermoune et al. (2008), we have, for every j, consistent estimators for Hj 


and Tj: 


and 


n—3 


^ +1)’ 
^ ' i—\ 


n-2 


n—3 


(„) = ^Y. + 57;rr^ S PxHi)Px>(i +1)^ 


2(n-3) ^ 

^ ' t — 1 


Lemma 5. The following statistics 

OO 

t,u{n)h = y^Jij{n){h,ej)ej 


i=i 


n—3 


= E E PX^^)PX^{^ + 1) j {h, e,)e, 


n—3 




and 

OO 

S„(n)h = ej)ej 


i=i 

OO 


n—3 


(40) 






= E E E PX^i^)PX^i^ + 1) (h, e,)e, 

j=l \ i=l ' i—1 ' 

3 

2(n- 3) 


1 n—2 n—3 

= — y: px(i)»(.+-— y; px(,)px(i + d/. 


2=1 


2=1 


(41) 


based on the time series of observation -PX, are consistent estimators of the covari¬ 
ance operator S„ and respectively. 

Proof. We only carry out the proof of consistency for the estimator S„. A similar 
proof for holds, by Proposition 2 in Dermoune et ai, we have after simple 
calculations 

var(A,(n)) = [(n - 3) {rf + 12r,/x, + 52^*^) 

+2(n — 4) (tj/Xj + 22/x|) + 2(n — 5)^|.] 

Then it holds for arbitrary h G L^([0,1]) that 


2 

2 

OO 

T,u{n)h — E„/i = A 

E(Ai(’^) -Pj )(/i.ei)ej 
i=i 


OO 

<'^P\T3in) - \\hf 
i=i 


OO 

= ||h||^ E ■^9'J'(Ai(^)) Oj as n —>■ OO 
i=i 
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with 


oo ^ oo 

^ var(/i,(n)) = , _ ^ [(n - 3) (t| + 

i=i ^ i=i 

+2(7z — 4) (rjiJjj -\- 22fij^ + 2(^ti — 5)/x^] 

is finite since E„ and T,y are trace class operators. □ 

The following theorem gives a consistent estimators of the optimal smoothing 
operator B. It is the functional time series extension of Theorem 1 in Dermoune et 
al. (2009). 

Theorem 6. The optimal smoothing operator B admits the following consistent 
estimator 


1/3 

est-B{n)h = - tXI 9 


/=i 


2 ' 


{h, ej)ej (42) 


based on the time series of observation PX. 
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